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ABSTRACT 

Although  adaptive  controllers  have  been  designed 
for  a  number  of  years,  the  central  question  of  global 
asymptotic  stability  of  the  overall  feedback  adaptive 
loop  and  its  associated  error  equations  remained  open 
until  recently.  The  two  main  approaches  used  to 
design  controllers  from  a  stability  viewpoint  - 
Lyapunov's  Direct  Method  and  Popov's  Hyperstability 
Theory  -  only  assure  boundedness  of  the  (augmented) 
state  and  parameter  errors.  The  difficulties 
encountered  in  both  approaches  are  analyzed  and 
shown  to  be  exactly  analogous. 

Subsequently,  a  generic  model  for  an  adaptive 
controller  is  proposed  from  which  already  existing 
adaptive  algorithms  can  be  derived  with  minor  modi¬ 
fications.  The  model  unifies  various  algor ithms, 
under  the  essential  requirement  for  positive  reality 
of  the  associated  error  transfer  function} and  Its 
proof  of  stability  contains  others  suggested  to  date 
as  special  cases.  Finally  some  general  comments  are 
made  regarding  rates  of  convergence,  performance  of 
the  algorithms  In  the  presense  of  disturbances  and 
un modeled  dynamics,  ease  of  Implementation,  etc.« 

I  INTRODUCTION 

Adaptive  control  has  witnessed  some  very 
Important  theoretical  developments  in  recent  years. 
Although  the  state  of  the  art  Is  still  far  from  being 
satisfactory  for  most  practical  applications,  the 
progress  made  so  far  is  encouraging  and  suggestive  of 
new  directions  for  the  improved  performance  of  adap¬ 
tive  algorithms. 

In  the  past  few  years  various  adaptive  control¬ 
lers  were  proposed  reflecting  different  philosophical 
viewpoints,  such  as  direct  and  Indirect  control,  and 
baaed  on  different  methodologies,  motivated  either 
from  a  stability  approach  to  the  problem  or  from 
optimization  considerations .  Quite  recently,  Che 
mathematical  equivalence  between  direct  and  indirect 
control  was  established  [1,2],  -at  least  for  certain 
parameter lzations  of  the  plant -while  it  has  become 
Increasingly  evident  that  there  Is  considerable  over¬ 
lap  of  the  problems  encountered  using  either  the 
optimization  or  the  stability  approach  for  designing 
adaptive  controllers  with  inaccessible  process  states, 
particularly  as  the  latter  relate  to  the  question 


This  research  was  supported  in  part  by  the  Air 
Force  Office  of  Scientific  Research  under  contract 

number  .  AP«*R-77-JSLg/ 


of  global  asymptotic  stability  of  the  resulting 
feedback  adaptive  loop.  In  fact,  this  question  became 
of  crucial  Importance  in  the  study  of  adaptive  systems 
and  was  not  resolved  until  very  recently  (3,4,5]. 

Even  so,  the  results  pertain  only  to  the  case  of 
"deterministic"  adaptive  systems*  while  no  proof  of 
the  stability  in  the  global  sense  is  available  for 
"stochastic"  adaptive  schemes,  where  disturbances  are 
present  in  the  form  of  observation  and/or  process 
noise.  The  most  glgorous  results  along  these  lines 
were  obtained  by  IJung  [6,7],  who  used  the  (by  now) 
well-known  method  of  the  "associated  differential 
equation"  corresponding  to  the  stochastic  adaptive 
problem.  However,  these  proofs  are  valid  only 
locally. 

The  two  major  aspects  of  the  general  control 
problem  were, first,  the  design  of  a  controller  for  an 
unknown  plant  from  Input-output  data  alone,  with  no 
accessibility  to  any  other  points  in  the  plant;  and 
second,  because  of  noise  considerations,  the  exclusion 
of  explicit  use  of  differentiators.  Since  adjustment 
of  the  parameters  Is  not  possible  due  to  restricted 
accessibility  of  the  plant,  such  a  controller  would 
have  to  be  realized  by  synthesis  of  its  input.  This 
difficulty  was  enhanced  by  the  generation  of  nonlinear 
time-varying  differential  (difference)  equations  for 
the  adaptive  loop,  due  to  feedback.  Thus,  the 
adaptive  control  problem  turned  out  to  be  considerably 
more  complex  than  that  of  the  adaptive  observer, 
where  not  only  every  point  in  the  adaptive  system 
(observer)  was  accessible  but  also  its  open-loop 
scheme  resulted  in  linear  differential  equations.  The 
first  clear  exposition  of  all  complications  arising 
in  the  adaptive  control  problem  was  given  in  [8]. 

From  the  mathematical  point  of  view,  the 
Inaccessibility  of  any  point  in  the  plant  other  than 
its  input  and  output  could  be  translated  as  the 
difficulty  in  realizing  a  positive  real  output  error 
transfer  function  (Ref.  Section  III).  An  important 
contribution  along  these  lines  was  made  by  Monopoli 
[9],  who  suggested  an  Ingenious  scheme,  for  control. 


*  He  note,  here,  that  our  ensuing  discussion  will 
be  primarily  concerned  with  the  on-line  control  of 
linear,  time-invariant,  SISO  plants  under  insufficient 
knowledge  of  their  parameters  and/or  state  variables. 
There  are  very  few  results -if  any  at'  all  -  that  are 
rigorous  pertaining  to  the  more  general  cases  of 
time-varying  and/or  multivariable  plants. 

2 

This  problem  was  well  understood  and  completely 
resolved  by  the  first  half  of  the  decade. 
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by  asking  use  of  sn  augmented  error  signal . ^  However, 
while  error  sugnentatlon  maintained  boundedness  of 
the  stste  end  psrsaeter  errors,  It  could  no  longer 
be  sssumed  thst  either  the  plant  or  the  model  states 
remained  bounded  (Ref.  Section  II).  Motivated  by 
Monopoli's  approach,  Narendra  and  Valavawi  [10] 
succeeded  In  designing  a  simple  controller  structure 
which  realized  a  positive  real  output  error  transfer 
function  during  adaptation.  The  stability  problem 
of  the  overall  adaptive  loop  was  also  clarified  In 
that  work  and  its  solution  was  presented  in  the  form 
of  a  conjecture.  A  modified  version  of  the 
conjecture  Involving  an  additional  feedback  term  was 
recently  verified  [3].  At  about  the  same  time, 

Feuer  and  Morse  [11]  suggested  an  alternative 
controller  but  its  extreme  complexity  precludes  its 
use  In  practical  applications.  Since  then,  several 
authors  [5,2,12,13]  have  also  attempted  this  problem 
for  both  discrete  and  continuous  systems.  In  [2] 
both  discrete  as  well  as  continuous-time  controllers 
are  discussed  and  compared.  In  [12]  and  [13]  the 
continuous  adaptive  problem  is  treated  -  using  indirect 
control  ideas -when  the  input  to  the  system  is 
"sufficiently  rich."  Proof  of  asymptotic  stability 
here  heavily  hinges  on  the  assumption  of  convergence 
of  the  parameters.  However,  simulation  studies  of 
any  of  the  adaptive  control  algorithms  available 
to  date,  consistently  show  that  the  above  assumption 
almost  never  holds,  despite  the  fact  that  the  output 
errors  tend  to  zero;  this  fact  should  not  be 
surprising,  since  the  control  objective  -  i.e. ,  output 
error  tending  to  zero  -  is  nonetheless  satisfied. 

Finally,  in  [5]  the  authors  present  three  very 
simple  adaptive  controllers  for  discrete  time  systems 
using  both  a  direct  as  well  as  an  indirect  control 
approach.  The  motivation  for  the  schemes  they  propose 
cones  from  optimization  considerations  rather  than 
the  explicit  use  of  the  stability  approach  in  the 
design,  since  two  of  their  algorithms  are  projection 
algorithms  on  the  (estimated)  parameter  space  and  a 
third  algorithm  employs  recursive  least  squares. 

After  careful  study  of  the  algorithms  in  [5]  and 
contrary  to  what  was  initially  believed,  it  Is 
interesting  to  find  out  that  they  also  implicitly 
realize  a  positive  real  output  error  transfer  function. 
This  is  an  important  observation,  since  positive 
reality  has  been  a  key  requirement  in  the  analysis 
and  design  of  adaptive  controllers  using  either 
Lyapunov's  Direct  Method  or  Popov's  Hyperstability 
Theory.  With  either  method,  adaptive  laws  that 
guarantee  the  global  stability  of  the  overall  scheme 
are  derived.  Unfortunately,  however,  neither  one 
alone  can  allow  the  conclusion  of  asymptotic  stability 
for  all  cases  of  control  and,  therefore,  special 
analysis  is  further  required. 

In  Section  II  we  discuss  an  error  model  which 
is  most  frequently  (almost  Invariably)  used  in 
adaptive  control  under  limited  state  information. 

In  Section  III  we  present  briefly  the  main  features 
of  both  Hyperstability  Theory  and  Lyapunov's  method 
and  point  out  the  difficulties  encountered  in  the 
proofs  of  asymptotic  stability  of  augmented  error 
systems.  Section  IV  contains  the  main  contribution 
of  this  paper  which  is  a  generic  model  for  the  design 


^Use  of  an  "augmented  error"  became  necessary 
whenever  the  relative  degree  of  the  plant  transfer 
function  (i.e.,  excess  of  poles  over  zeros)  was 
greater  than  or  equal  to  three. 


of  stable  adaptive  controllers.  This  model  captures 
in  a  unified  manner  all  the  essential  features  of 
already  existing  adaptive  control  algorithms.  The 
latter  can  be  derived  from  this  general  model  with  minor 
modifications.  This  is  discussed  in  Section  V  for  a 
representative  number  of  algorithms.  Moreover,  the 
model  clarifies  the  role  of  relative  degree  and 
positive  reality  of  the  error  transfer  function  and 
shows  quite  convincingly  that  the  latter  is  one  of 
the  two  main  underlying  factors  in  the  already  exist¬ 
ing  asymptotically  stable  adaptive  schemes;  the  second 
is  that  the  parameter  adjustment  law  satisfy  some 
conditions  such  as  being  an  L 2  function,  which  is  the 
only  case  for  which  a  proof  is  available  at  present.  The 
asymptotic  stability  proof  is  presented  briefly  -  rather 
outlined -in  Section  VI.  In  retrospect,  some  of 
the  stability  proofs  given  to  date  are  seen  to 
be  special  cases  of  the  (outline  of)  proof  in  VI. 

Section  VII  contains  general  comments  on  adaptive 
algorithms,  i.e.,  regarding  their  rates  of 
convergence,  their  behavior  in  the  presence  of 
disturbances  and  unmodeled  system  dynamics,  etc. 

The  conclusion  is  given  in  Section  VII. 


Due  to  space  limitations,  presentation  of  the 
results  is  kept  concise  and  proofs  are  only  outlined 
in  most  cases  instead  of  given  in  detail.  Whenever 
necessary,  reference  is  made  either  to  already  existing 
proofs  or  to  a  more  expanded -hence  complete  -  version 
of  this  paper  (Sections  IV,  V  and  VI  in  particular) 
in  which  the  proofs  are  Included.  The  discussion  is 
carried  out  for  continuous  time  systems  and  the  easier 
cases  of  discrete-time  systems  are  mentioned  whenever 
appropriate,  (It  is  much  easier  to  derive  results 
going  from  continuous  to  discrete-time  rather  than 
vice  versa) . 

II  AN  ERROR  MODEL  IN  ADAPTIVE  CONTROL 

The  error  model  described  in  this  section  is  also 
known  as  Prototype  III  in  the  adaptive  control  liter¬ 
ature  [14],  It  applies  to  the  case  where  only  the 
plant  output  Is  accessible  and,  therefore,  neither 
the  entire  error  nor  plant  scate  vectors  can  be  used 
in  the  implementation  of  the  adaptive  algorithm. 
Stability  of  such  algorithms  is  then  difficult  to 
ensure,  unless  the  adaptive  system  can  be  para¬ 
meterized  in  a  specific  form.  It  is  quite  often  the 
case  that  the  error  differential  equations  of 
adaptive  systems  whose  entire  state  vector  is  not 
accessible  can  be  put  in  the  following  form  [14]: 

e(t)  *  Ae(t)  +  b$T(t)  u(t)  (1) 

ex(t)  -  cTe(t) 

where  e(t)  is  an  (nxl)  state  vector,  $(t)  and  u(t) 
are  m-dlmensional  vectors  with  the  elements  of  u(t) 
piecewise  continuous  and  uniformly  bounded.  A  is 
a  stable  (hxn)  matrix,  b  and  c  are  (nxl)  constant 
vectors,  with  (A,b)  completely  controllable,  and 
the  transfer  function  cT(si-A)“^b  Is  strictly 
positive  real  (SPR).  The  elements  of  the  vector 
i(t)  are  unknown  but  the  time  derivative  f(t)  can  bo 
adjusted  using  the  signals  u(t)  and  cj(t)  which  can 
be  measured.  The  aim  of  this  adjustment  is  to  make 
lim  e,(t)  »  0. 

t  *♦  AO 

If  the  adaptive  law  _ 

id)  «  -  ru(t)e1(t)  r  •  r  >  o  (.») 
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Is  chosen,  lc  can  ba  shown  easily  using  tha  Kaloan- 
Yakubovich  Lemma  that 

(i)  c(c)  and  i( t)  arc  bounded 

(ii)  11a  e<t)  -  0 
t  -  « 

and  (ill)  if  u(c)  is  "sufficiently  rich"  [15] 

Urn  $(t)  -  0 
t  +  » 

Proof:  Choosing  V(e,$)  «  1/2  [eTPe  +  $Tr“X$]  >  0  as 
a  Lyapunov  function  candidate,  the  tiae  derivative 
tr(e,$)  can  be  written  as 

V(e,A)  •  l/2eT[ATP  +  PA] a  +  eTPWTu  +  *Tr-1<b 

By  the  Kalman -Yakubovich  Lemma,  a  aatrlx  P  -  P^  >  0 
exists  such  that 

T  T 

A  P  +  PA  -  -qq  -  eL 

Pb  •  c 

for  some  vector  q,  matrix  L  ■  L~>  0,  and  e  >0  iff 
CT(sl  -  A)~xb  is  strictly  positive  real  (SPR) .  In 
suchicase, 

V(e,$)  ■  -l/2eX(qqX  +  €L)e  +  ejdTu  +  $Tr 

By  choosing  the  adaptive  law  according  to  (2),  v 
becomes 

V(e,$)  -  -l/2eT(qqT  +  eL)e  <  0 

so  that  the  system  is  stable  and  (1)  holds.  V, 
furthermore,  is  a  nonincreasing  function  of  time 
which  is  bounded  from  below  and  hence  converges 
to  a  finite  value  V®. 

We  first  consider  the  case  where  the  input  u(t) 
is  uniformly  bounded.  In  such  a  case  we  have 

lira  f*  tf(t)dt  -  V„-V(0) 

t-KO^ 

which  is  a  finite  number  and  [r(t^,  is  uniformly 
continuous  since  4(t)  and  hence  V  (t)  are  bounded. 
Hence  by  a  well  known  lemma  [18] 

lim  tf(t)  *  lim  -1/2  eT(qqT  +  cL)e(t)  “  0 

(  4  SB  t  4  * 

or  11m  e(t)  •  0  and  lim  ei(t)  ”  0 

C  «  t  ♦  • 

By  (2),  since  u(t)  is  bounded,  it  follows  that 

lim  $(t)  ■  0 
t  *  * 

It  has  also  been  shown  [IS]  that  if  u(t)  is 
"sufficiently  rich," 

lim  $(t)  "  0 

t  ♦  • 

The  results  stated  so  far  nay  now  be  stmnaarlzed  as 
follows: 

a.  If  V(e,B)  is  positive  definite  and  v(e,$)  is 
negative  semldeflnlte,  e(t),  B(t)  ere  bounded  If 
e(0),  p(0)  are  bounded. 


b.  If  the  input  u(t)  is  bounded (••$)  is  also 
bounded  and  hence 

lim  e(t)  “  0  lim  $(t)  »  0 

OO  [  ^  SB 

c.  If  u(t)  is  bounded  and  "sufficiently  rich" 

lim  $(t)  ■  0 
t  -  ® 

The  problem  becomes  considerably  more  complicated 
when  any  finite  time  truncation  of  u(t)  is  bounded, 
l.e.,  u(*)c  Ie  but  u(t)  is  not  uniformly  bounded. 

It  is  now  no  longer  possible  to  conclude  from  the 
above  analysis  that  e(t)  and  $(t)  behave  as  in  b. 
However ,  it  was  recently  shown  [16 ]  that  even  when 
the  Inputs  are  unbounded,  the  error  system  can  be 
uniformly  asymptotically  stable  provided  the  inputs 
are  "uniformly  exciting"  in  the  sense  of  [16].  Some 
of  the  principal  difficulties  in  the  resolution  of 
the  adaptive  control  problem  have  been  related  to 
these  questions  that  arise  when  the  control  input 
u(t)  to  the  plant  cannot  be  assumed  bounded  and,  further 
"uniform  excitedness"  is  not  assured .  Hence  an 
alternate  route  had  to  be  taken  in  the  proof. 

A.  A  Hod if led  Error  Model  for  Use  in  Asymptotic 
Stability  Proofs  in  "Augmented  Error”  Systems. 

Perhaps  the  most  important  step  in  achieving 
asymptotic  stability  of  the  adaptive  system  in  [10] 
was  in  introducing  an  extra  feedback  term  in  the 
error  model  described  by  equation  (1).  Figure  1 
is  a  schematic  representation  of  the  modified  error 
model. 


SPR 


FIGURE  1 


The  state  equations  describing  the  above  system  are 
given  by: 

d(t)  ■  Ae(t)  +  b|i*T(t)u(t)  -  UuT(t)  Tu(t)e^(t)  ] 
a  >0,  r  -  rT  >  0  (3) 

ejU)  “  cTe(t) 

and  the  adaptive  law  is  given  as  before  by 

><p(t)  -  -iwoe^t)  r  -  r  >  o 

Choosing  as  a  Lyapunov  function  candidate  the  sane 
V(e,$)  as  before,  we  obtain  its  time-derivative 
according  to  equations  (3)  and  (4)  as 

y(e,4>)  -  l/2eX(t)|/Jp  +  PA]e(t)  +  e~(t)PbUT(t)u(t) 

aux(t)fu(t)  ei(t)l  +  <T(t)r-1s‘(t). 
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Using  the  K  -  Y  Leans  and  equation  (4) 

V(e,$)  -  -l/2eT(qqT  +  EL)e  -  4?  fH  (5) 

From  the  face  that  V(e,$)  is  bounded  for  bounded 
initial  values  of  e  and  $  and  from  (5)  we  can.  , 
conclude  that  (l)e  eL  ,  je L^.  The  fact  that  $eLz 
is  crucial  in  the  stability  proof  of  Section  VL 
The  rest  of  the  stability  argunents  follow  exactly 
as  in  the  first  part  of  this  section. 

Ill  LYAPUNOV'S  METHOD  AND  HYPERSTABILITY  THEORY  IN 
ADAPTIVE  CONTROL 


Lyapunov's  Direct  Method  and, relatively  more 
recently,  Popov’s  Hyperstability  Theory  have  provided 
the  principal  framework  for  the  analysis  and  design 
of  adaptive  systems  using  a  stability  approach. 

Using  this  approach,  adaptive  problems  are  formulated 
as  stability  problems  of  multivariable  nonlinear 
nonautonomous  systems.  When  Lyapunov's  method  is 
employed,  the  asymptotic  stability  of  a  set  of  error 
differential  equations  is  studied  using  a  suitable 
choice  of  a  Lyapunov  function  candidate  (as  in 
Section  II) .  While  the  theory  has  been  applied 
effectively  to  autonomous  systems,  it  has  been  less 
decisive  in  the  adaptive  contexc  where  the  equations 
are  nonautonomous.  The  difficulty  lies  in  the  fact 
that  always  the  choice  of  the  adaptive  law  for  the 
updating  of  the  parameters  is  such  that  the  time 
derivative  of  the  Lyapunov  function  is  Invariably 
negative  semidefinlte,  rather  than  definite.  This 
together  with  the  fact  that  in  the  more  general  case 
of  time-varying  (rather  chan  autonomous)  differential 
equations,  which  arise  in  adaptive  control,  a 
correspondence  between  their  limiting  sets  and 
invariant  sets  has  not  been  established,  precludes 
use  of  LaSalle's  theorem  for  proof  of  asymptotic 
stability. 

The  hyperstablllty  approach  [17-20]  which  has 
been  Increasingly  used  as  an  alternative  to  Lyapunov’s 
method,  requires  the  problem  to  be  recast  as  the 
stability  of  a  feedback  loop  with  a  linear  time- 
invariant  operator  in  the  forward  path  and  a  passive 
operator  in  the  feedback  path.  This  structure 
provides  the  designer  with  greater  flexibility  in 
choosing  the  adaptive  laws,  since  it  is  merely 
required  to  make  the  feedback  block  satisfy  some 
passivity  conditions  for  the  system  to  be  hyper¬ 
stable.  However,  as  will  be  seen  in  the  sequel, 
this  approach  too  meets  with  the  same  analytical 
difficulties  when  unbounded  signals  are  present. 


Since  the  stability  of  the  error  model  in 
Section  II  was  analyzed  using  Lyapunov’s  method, 
we  will  present  in  this  section  only  the  hyper¬ 
stability  approach.  Consider  now  a  completely 
controllable  and  completely  observable  system  B,. 


*(t) 

y(t) 


Ax(t)  +  bu(t) 
cTx(t) 


’) 


System  Si 


where  A  is  an  (nxn)  matrix,  x(t)  an  (nxl)  vector, 
u(t)  a  piecewise  continuous  input  and  y(t)  the 
output. 


Hyperstability  of  is  then  defined  by  the 
property  which  requires  chat  the  state  x(C)  be 
bounded  for  a  certain  class  of  inputs  u(t).  This 
class  is  defined  by  those  !*(•)  which  satisfy  for  all  T 


f*  u(t)y(t)dt  <6(|1  x(0) ||  ]sup  |x(t)|i 
0  0  <  t  <  T 


where  6  is  a  positive  constant.  For  the  purposes 
of  our  discussion  it  is  adequate  to  limit  ourselves 
to  the  class  of  inputs  which  satisfy 
2 

u(t)y(t)  <_  1  Independent  of  T 
o 


clast 

f. 


(6) 


as  suggested  by  Landau  [19  1,  where  1  is  an 
arbitrary  constant,  independent  of  T. 


Definition:  The  system  B^  is  hyperstable  with  respect 
to  any  u(t)  which  satisfies  (6)  if  there  exists  a 
positive  constant  k  such  that 


|x(t)»  <  k[|  x(0)H  +  1]  for  all  t  (7) 

Definition:  The  system  B^  is  said  to  be  asymptotically 
hypers table  with  respect  to  any  u(t)  satisfying  (6) 
which  is  also  bounded  if  the  inequality  (7)  holds 
together  with 

lim  x(t)  ■  0  (8) 

£  —  OO 


The  main  theorems  of  Popov  may  now  be  stated  as 
follows . 


Theorem  1.  (Hyperstability):  A  necessary  and  sufficient 
condition  for  the  system  Bl  to  be  hyperstable  is  that 
the  transfer  function 

W(s)  -  cT(sI-A)*1b  (9) 

be  positive  real  (PR) . 


Proof:  See  f 1 7] . 


Theorem  2.  (Asymptotic  Hyperstabilitv):  A  necessary 
and  sufficient  condition  for  the  system  Bj  to  be 
asymptotically  hyperstable  is  that  K(S)  in  (9)  be 
strictly  positive  real.  (SPR). 

If  Bi  is  SPR,  it  can  be  shown  [18]  that  a 
positive  definite  function  p(x)  exists  such  that 

i 

When  u(t)  is  bounded,  the  function  p[x(t)]  can  also 
be  shown  to  be  uniformly  continuous.  Hence,  from 
(10)  and  (6)  and  a  well  known  lemma  (BarbBlat's 
Lemma  in  [18]),  it  follows  that 

lim  p[x(t)]  -0  or  lim  x(t)  -  0 
t  ■*  w  t  •*  » 

Remark:  Uniform  continuity  of  p[x(t)]  [and  of 

analogously],  is  only  a  sufficient  condition 
in  these  proofs. 


p(x)dx 


(t)y (t)dt 


(10) 


We  now  apply  the  above  theorems  to  the  error 
model  discussed  in  Section  II.  Figure  (2)  is  a 
schematic  representation  of  system  (1)  and  (2) 

In  the  form  suggested  in  theorems  1  and  2. 


s 


SPR 


FIGURE  2  *2 


Since  P  v(t)e.(t)dt  -  -/  4>T(t)r_1$(t)dt  - 
'  o  1  '  o 

ll»(o)llr-«  -tomltr-*  <  U»(0)ili2-t 

2  2 

by  Theorem  2  the  state  vector  e(t)  of  B,  is  bounded. 
Similarly,  by  considering  B2  in  which  l/s  is  a 
positive  real  transfer  function,  the  state  vector 
4(t)  can  be  shown  to  be  bounded.  This  corresponds  to 
condition  (i)  in  Section  II.  If  u(t)  is  bounded, 
then  so  is  the  input  u(t)  to  B^.  Since  Bi  has  a  SPR 
transfer  function,  by  Theorem  2,  eft)  and  hence 
ei(t)  tend  to  zero  as  t  -*■ 00 .  This  corresponds  to 
condition  (li)  in  the  previous  section.  The  rest 
of  the  analysis  is  Identical  to  that  in  Section  II. 

Note:  In  many  adaptive  control  situations  it  may  be 
easier  to  check  conditions  (6)  and  (10),  rather  than 
searching  for  a  Lyapunov  function  and  trying  to 
assure  at  least  negative  semidefiniteness  of  its 
time  derivative.  In  fact,  the  integral  conditions 
(6)  and  (10)  may  provide  the  designer  with  more 
flexibility  in  choosing  the  adaptive  laws,  rather 
than  the  pointwise  condition  required  of  v(e  ,t) . 

It  is  obvious  from  the  discussion  that  hyperstability 
theory  offers  design  advantages  rather  than  analyti¬ 
cal  ones. 

IV  A  GENERIC  MODEL  FOR  ADAPTIVE  CONTROLLER  STRUCTURES 

Before  we  proceed  to  describe  the  general  con¬ 
troller  model,  we  give  a  brief  statement  of  the 
problem  below. 

A.  Statement  of  the  Problem 


nomlal  of  degree  m(<n-l),  q(s)  a  oonlc  polynomial 
of  degree  n  and  kp  a  constant  gain  parameter.  We 
further  assume  that  only  m,  n  and  the  sign  of  kp 
are  known  for  use  in  the  design  of  an  adaptive 
controller  and  only  one  output  of  the  plant,  i.e. , 

[h_T  ■  (1,0... Oj  is  accessible  for  measurement, 
n*  ”  (n-m)  is  referred  to  as  the  relative  degree 
of  the  plant  and  plays  an  important  role  in  the 
parametrizatlon  of  the  controller  in  this  section. 

We  note  here,  that  since  the  only  points  of  access 
to  the  plant  are  its  input  and  output,  any  internal 
structure  representation  (hp  ,Ap.bp)  can  be  assumed 
which  satifles  (11).  However,  the  "specific  para- 
metrlzation"  chosen  is  an  essential  ingredient  in 
the  subsequent  development  of  the  controller-reference 
model  structure. 

A  reference  model  M  represents  the  behavior 
desired  from  the  plant  when  it  is  augmented  with  a 
suitable  controller.  The  model  has  a  reference 
input  r(t)  which  is  uniformly  bounded  and  an  output 
ya(t).  The  transfer  function  of  the  model,  denoted 
by  Unfa)  may  be  represented  as 

Wa(s)  -  k*  Pm(3) 

qa<s) 

where  pK  (s)  is  a  monic  Hurwitz  polynomial  of  degree 
nl  4  “,  4  <Jm(s)  is  a  monic  Hurwitz  polynomial  of 
degree  n  and  k,,,  is  a  constant  gain.  Wa(s)  is 
completely  specified  and  the  aim  of  the  design  is 
to  generate  suitable  bounded  inputs  u(t)  to  the 
plant,  so  that  the  deviation  of  the  plant  from  the 
desired  behavior  as  measured  by  an  error  signal 
El(t)  where 

lEl<e)j  -  lyP(t>  -  ya(Ol 

tends  to  zero  as  t-*  ®. 

B.  Plant  and  Controller  Representation. 

Here,  we  present  a  general  observer-controller 
structure  which  yields  a  simple  relation  between 
observer  and  controller  parameters  (similarly  as  in 
[1]).  In  fact,  since  the  mathematical  equivalence 
between  direct  and  indirect  control  was  proven  [1,2], 
the  general  structure  presented  here  could  be  viewed 
as  either.  The  following  Lemma  and  Corollaries 
are  needed  to  justify  what  will  follow. 

Lemma  1:  Given  the  relatively  prime  polynomials 
p  and  q  of  degrees  m(<n-l)  and  n  respectively,  with 
q  monic,  a  monic  polynomial  T  and  a  polynomial  A 
of  degree  n  exist  such  that  the  polynomial 


The  plant  P  to  be  controlled  is  completely 
represented  by  the  input-output  pair  £u(t) ,yp(t)j and 
can  be  modeled  by  a  linear  time-invariant  system 


xp  »  Apxp  +  bpu(t) 
yp  •  hpT*p(t) 


where  Ap,  bp,  hp  are  a  matrix  and  vectors  of  constants 
and  are  of  compatible  dimensions  and  such  that  the 
transfer  function 


Wp(s)  *  hpT(-sI 


-  *nrh, 


kpP(s) 

q(s) 


(11) 


is  strictly  proper;  p(s)  is  a  monic  Hurwitz  poly- 


Tq  +  Ap  ■  M 

where  M  is  any  2n  degree  monic  polynonial. 

Pf:  Given  in  [10]. 

Corollary  1:  If  Mj  is  any  monic  polynomial  of 
degree  (2n+m)  such  that  Mj  ■  MO,  where  0  is  a  monic 
polynomial  of  degree  m,  polynomials  ft  and  Aj  of 
degrees  (n+m)  exist  which  satisfy 


Since  the  controller  structure  to  be  described 
in  the  sequel  is  motivated  by  the  indirect  control 
representation  in  [14],  we  will  assume,  witli  no  loss 
of  generality,  that  mj  *  m.  When  mj  >  m,  r(t)  has 
to  be  suitably  prefiltered. 

this  f:  0  -  ’ 

•i’ivvzt  I.U.  e  * 


1*4 ***** 


y 
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r i<i  +  Aip  -  mj 

This  follows  directly  from  L earns  1  by  choosing  ri“r<7 
and  A^«A0 

Corollary  2;  Given  two  polynonials  L(s)  and  A(s)  of 
degrees  (n-m)  and  n  respectively,  if  p(s)  and  q(s) 
are  relatively  prime  polynomials  of  degrees  m  and  n, 
then  the  rational  function  p(s)/q(s)  can  be  expressed 
as 


£l£i  .  Jig). _ 

q(s)  A(s)t(s)  +  A(s) 


(12) 


by  the  proper  choice  of  the  polynomials  T(a)  and 
A(s)  of  degree  n. 

Proof:  Equation  (12)  implies  Tq  -  Ap  *  pAL  and 
since  the  RHS  is  of  degree  2n,  Leans  1  applies 
directly. 

Figure  3b  is  an  equivalent  nonmlnimal  representa¬ 
tion  of  a  plant  with  an  irreducible  transfer  function 
p(s)/q(s) ,  according  to  Corollary  2  and  with 
A(s)  -  pm(s)C(s). 


In  Figure  4,  the  block  representing  the  plant 
is  realized  in  the  nonmlnimal  representation  shown 
in  Figure  3b  and  (the  parameters  In)  the  poly¬ 
nomials  r(s)  and  A(s)  are  adjusted  using  input  and 
output  data,  so  that  r  «  T*  and  A  *  A*  asymptotically. 

The  above  representation  of  the  plant  and  observer 
motivate  the  basic  structure  for  the  model  reference 
controller,  which  is  derived  in  an  exactly  analogous 
manner  as  in  [1  ].  Figure  5  is  a  schematic 
diagram  of  the  controller. 


(hT,A,b) 


FIGURE  3b 


FIGURE  5 


In  figure  3  the  only  condition  on  L(s)  is  that  its 
degree  be  the  same  as  the  relative  degree  of  V  (s) 
and  that  it  be  a  Hurwltz  polynomial  and  L(s)  ■  l(sls+a) 
where  L(a)  is  of  degree  (n*-l)  and  a>0. 

From  the  representation  of  the  plant  above, 
and  following, in  an  exactly  analogous  manner  the 
developments  in  [  10],  we  are  motivated  to  represent 
an  observer  as  shown  in  Figure  4. 


Since  it  can  be  shown  as  in  (1]  that  the  (nxl) 
vectors  c  my  and  the  ((n+l)xl)  vectors  d  »  61 
the  input  to  1/L(s)  in  block  B  is  0  in  this  case. 
However,  block  B  will  be  seen  later  to  account  for 
the  augmentation  to  the  output  error,  when  deg  (E(s))»2. 


Note:  The  above  diagram  corresponds  to  the  case 
where  tfe  gain  k  of  the  plant  is  knowr.  and  can, 
therefore,  without  loss  of  generality* be  assumed 
that  kp"  kfl,  »  1.  When  kp  is  unknown,  the  basic 
structure  remains  the  same;  an  extra  adjustable 
parameter  cQ  multiplies  the  reference  input  to  the 
plant  and  kp  multiplies  1/E(s)  in  its  forward  path, 
as  shown  in  dotted  circles  on  Figure  5.  If 
A(s)  “  L(s)pm(s),  the  controller  in  Figure  5  can 
match  any  transfer  function  k,,,  Pm(s) .  (The  proof 

'  dm(s) 

follows  from  Corollary  2  after  substituting  for  .’.Is', 
both  for  kp  known  and  unknown.) 

Note  2:  The  reference  model  is  Incorporated  into 
the  scheme  of  Figure  5  as  shown,  because  we  ultimately 
want  to  focus  attention  on  the  transfer  function  -I— 
which  can  be  shown  [  21  ]  to  describe  the  reduced 
state  arror  dynamics. 


IHiiJ  •  ■  -- 


FIGURE  4 
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The  state  equations  for  the  state  variable 
filters  Fi  and  F2  are  described  by 

v'2>  -  Av(1>  +  bu) 

c/D  -  cTv(1)  J  Fl 


v(2> 

J2> 


Av(2)  +  byp  *)  ^ 
d0yp+  dTv<2>-> 


(13) 


where  A  Is  an  (nan)  stable  matrix  (in  companion 
form,  usually),  $  -  (0,  0,...,1),  cT-  (cj,  C2...,cn) 
and  dT  •  (d0,  dj^.-d,,) 


It  Is  shown  in  [21]  that  the  error  equations 
(14)  can  be  expressed  In  reduced  form  as 

?(t)  -  AE(t)  +  bWT(t)w(t)  -t»c1(t)t,T(t)rw(t)]  (15) 

ex(t)  -  hTe(t)  bT  -  (0,.,*,1)  hT«  (1,Q*C) 

and  that  (t)  and  £^(t)  are  equivalent.  A  Is  an 
(n*  x  n*)  stable  matrix  and  Wg(s)  £  h”(sI-A)“1b  * 
l/Ks),  u(t),  ♦(t)  as  defined  before.  Note  that 
with  n*  ■  1,  (15)  Is  a  scalar  differential  t^i**):**'- 
and  hence  its  transfer  function  Is  always  SPR. 

The  form  of  equations  (15)  Is  particularly  useful 
In  the  analysis  of  the  controller  In  Figure  5. 


Defining 

5T(t)  4 

d0(e),  dx(t) 


[c0(t).  eT(t)]  -  (c0(t),  ci(t). 


»  ^(*5* 

d_(t)],ST(t)  -  [r(t) ,  <aT(t)] 

-  [r(t) ,  v(1)T(t),  yp(t),  v(2)T(t)l 


the  Input  to  the  plant,  as  shown  in  Figure  5  is 
u(t)  fi  5T(t)J(t) 


and,  using  the  modified  model  of  Section  II, 

u(t)  -  5T(t)5(t) -ac.(t)ST(t)ru(t)  r  -  rT>o 

a  >n 

When  the  gain  of  the  plant  is  known,  w.l.o.g.  kp-k^l 
and  cc  “  0. 

o°0  u(t)  -  0T(t)<u(t)  -  ae1(t)coT(t)r4i(t) 

We  shall  examine  this  case  first. 


(1)  kp  “  km  "  1  (known) 

Following  the  results  of  [10  ]  (also  summarized 
by  the  Lemma  and  Corollaries  In  the  beginning  of 
this  section),  a  constant  control  parameter  vector 
9*  exists  such  that.  If  0(t)  =  9* the  transfer 
function  of  the  plant  together  with  the  controller 
matches  that  of  the  model  exactly.  If  e(t)  repre¬ 
sents  the  state  error  between  comparable  represent¬ 
ations  of  model  and  plant,  the  error  differential 
equations  are: 

e(t)  -  AcC(t)  +  bc[$T(t)«(t)  -  ae1(t)«T(t)rw(t)) 

^(t)  -  h|e(t)  (14) 

where  We(s)  ■  hcT(sI  -  Ag)”^  "  wB(s)  and 
♦  (t)  -  8  (t)  -  8* 
is  the  parameter  error  vector, 
a.  n*  ■  1 


If  the  relative  degree  of  the  plant  Is  equal  to  one, 
w.l.o.g.  the  model  transfer  function  can  be  assumed 
positive  real  [10].  Hence,  according  to  the  results 
in  Section  II,  the  adaptive  laws 

;(t)  -  -ex(tMt) 

assure  the  boundedness  of  $(t)  and  £(t).  Since  the 
states  of  the  model  are  bounded,  boundedness  of  the 
plant  states  follows  and  further  analysis  is 
Identical  to  that  In  Section  II,  for  u(t)  bounded. 
(u(t)  ■  <»(t)  here). 


L _ 


b.  n*  *  2. 

If  the  relative  degree  n*  -  2,  Ug(s)  is  a  second 
or  higher  order  (n*order)  transfer  function,  so  that 
it  is  not  SPR.  However,  since  L(s)  is  known,  and 
arbitrary*  a  Hurwitz  polynonlal  L*(s)  ■  AL(s)  or 
L*(s)  "  XL(s)^>0  ,  can  be  defined  such  that  L*(s) 

W?(s)  »  L*(s)L-1(s)  is  SPR.  If  every  parameter 
6i(t)  in  the  controller  in  Figure  5  is  replaced  by 
an  operator  fi/(®i(t)]  *  L*(s)  SiL*-1(s),  the 
adaptive  laws  can  be  derived  according  to  the  error 
model  in  Section  II  as  0(t)  -r*iL(t) ,  where 
5(t)  •  L*-1(s)Iio(t) .  However,  if  the  controller  is 
to  be  differentiator  free,  such  a  procedure  is  not 
possible  through  the  plant,  anymore  specifically, 
through  the  transfer  function  t_J(s)  in  its  forward 
path.  Following  then  the  approach  in  [10],  correspond¬ 
ing  to  every  feedback  signal  6i(t)ti(t)  to  the  plant, 
a  signal  [61(t)  -  PL*10 i(tJl]ul(t)  is  realized  through 

the  transfer  function  L-1(s)  in  box  B  which  now  forms 
part  of  the  "augmented  model."  Hence  the  positive 
reality  of  the  error  transfer  function  is  preserved, 
and  so  are  the  adaptive  laws  thus  derived.  The 
augmented  error  controller  is  shown  in  Figure  6. 

The  quantities  in  dotted  circles  should  be  ignored 
(set  equal  to  1)  for  the  case  where  kp  is  known. 

Note  that  the  particular  representation  of  the 
reference  model  in  Figure  6  is  for  mathematical 
convenience  only,  so  as  to  derive  the  error  equations 
in  the  reduced  form  given  by  (15).  ya(t)  is  the 
augmentation  to  the  model  output  (block  A  of  Figure  5) 
and 

ya(t)  -  We(s)L*(s)[(L*_1(s)0(t)  -  6(t)L*‘1(s))Tu(t)  + 

+  aex(t)eT(t)rc(t)]  («) 


The  total  output  of  the  model  y(t)  is  the  sum  of  the 
desired  output  y„(t)  and  the  augmented  output  ya(t); 
the  augmented  error  e^(t)  is  defined  as 

ei(t)  fi  yp(t)  -  y(t)  -  ci(t)  -  yQ(t)  (17) 

and  given  by 

ex(t)  «W-(s)L*(s)[$T(t)i;(t)  -ae!(t)5T(t)r<;(t))  (18) 


(18)  has  the  same  form  as  (14)  with  «(t)  and  i'j(t) 
replaced_bv  r(t)  and  e^(t)  respectively.  Also 
Wf(s)  ■  L  *(s)  throughout  this  section 


(ii)  kp  unknown 

This  is  the  case  shown  in  Figure  6,  with  the 
quantities  in  dotted  circles  included.  Following  the 
analysis  in  [3],  the  aug-mented  error  equation  is  now 
given  by 
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FIGURE  6 


Notice  that  the  error  transfer  function  in  Figure  7 
is  at  most  of  first  order  if  L*(s)  ■  lL(s)  * 

This  is  a  generalization  to  the  model  considered 
in  [3.10) . 

V  OTHER  ADAPTIVE  ALGORITHMS 

The  special  parameterization  used  for  the  plant 
and  the  controller  in  the  preceding  section  resulted 
in  a  very  simple  structure  for  the  adaptive  system 
and  its  associated  error  equations.  The  model 
suggested  in  IV  is  the  simplest  controller  realization 
so  far  and  at  the  same  time  provides  a  very  precise 
exposition  of  the  functions  of  the  most  essential 
features  -  i.e. ,  relative  degree,  positive  reality  - 
in  the  design  of  stable  adaptive  control  systems. 

By  choosing  different  representations  for  the  transfer 
function  Tn*(s)»U»jin  the  forward  path  of  the  plant  - 
whose  relative  degree  has  to  be  n*,  same  as  the 
plant 'a  -  various  controller^can  be  derived.  This 
choice,  in  turn,  affects  the  "realization”  of  the 
SPR  transfer  function  We  that  describes  the  error 
dynamics  in  the  transient iiate  of  the  adaptation 
process.  Ue  mention  a  few  representative  algorithms 
below: 

1.  Monopoli's  Scheme  Ol 

T„*(s)  -  pm(s)/qnl(s)  -  Wm(s) 

We(s)  •  pm(s)/qm(s)  •  Us)  «  Wm(s)L(s), 

where  L(s)  is  chosen  such  that  Wt(s)  is  SPR.  Contol 
laws  are  as  follow  from  use  of  the  error  model 
in  Section  II. 


e^c)  -k5.[Wi(s)L*(s)][jT(t)i(t)  +  f(tK(t)J  - 
-ae1(t)C(t)Tr;(t) 

and  the  adaptive  laws  are 


2.  Narendra  and  Valavanl's  Schemes:  (Both  Direct 
and  Indirect  Control)  [1,10] 

T„*(s)  -  pm(s)/qn(s)  -  VI^Cs) 

wt(s)  •  Hjj(s)L(s),  where  L(s)  is  chosen  as  in  1. 

3.  Benejean's  Scheme  [22] 


i(t)  »  -  rej/tKU) 
?<t)  -  -yex(t)f(t) 


(20) 


where 

5(t)  “  L*“X(s)Iw(t)  ;  |(t)  -  [L*“X(s)5(t)-?(t)L*Ts)lJ(t) 

and  nO-l-j^Vt)  with  ^(t)*^ 

P  km 

The  stability  problem  that  arises  is  the  same  in  both 
cases  (1)  and  (ii),  with  n*  £  2.  In  a  schematic  form, 
the  modified  conjecture  for  kp  known  in  [3,10]  is 
represented  as  shown  in  Figure  7. 


Choices  of  transfer  functionsare  identidal 
to  Monopoll's. 

4.  Narendra  and  Lin's  Discrete  Control  Scheme  [23] 

[23]  is  the  discrete  version  of  [1,10]  in  2 
above,  and  therefore  the  transfer  functions  are  the 
discrete-time  analogs  of  those  in  2. 

5.  Goodwin,  Ramadge  and  Caines'*  Scheme  [5] 

The  algorithss  here  represent  the  only  adaptive 
controllers  listed  so  far  that  were  not  designed 
using  a  stability  approach,  but  are  rather  projection 
algorithms  -  :vo  of  them  (one  each  for  direct  and 
Indirect  control)  and  a  third  one  which  is  a  recursive 
least  squares  algorithm,  all  in  discrete-time.  Since 
they  are  all  similar,  we  mention  just  one  of  them 
here. 

GRC  Projection  Algorithm  II 
a.  Discrete-time 
9k  -  0k_!  t 


FIGURE  7 
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9k-l  +  *k^kelk 


where  e^.  and  e^.  are  Che  output  and  augmented  errors 
respectively,  and  C,k  is  the  "delayed"  (filtered) 
state  vector,  all  defined  in  an  analog»dnanner  as 
in  Section  IV, 


1  +r  *  c 


b.  Continuous-time 

Though  the  authors  in  (5]  described  discrete 
time  algorithms  only,  the  continuous  time  analog  of 
their  algorithm  above,  can  be  expressed  in  terms  of 
the  general  model  in  IV,  with 

-  rfe- 

We(s)  «  L*(s)L-1(s) ,  where  L*(s)  -  XL(s).  Hence, 
the  only  difference  from  the  model  in  IV  is  in 
realizing  the  augmented  error  equation,  which  is  now 
given  by 

ejU)  -  *T(t)C(t)/[X  +  aCT(t)rC(t)J  (22) 

where  $(t)  is  the  parameter  error  vector,  C(t)  as 
defined  in  Section  IV  and  everything  else  the  same 
as  in  the  model  of  section  IV.  (There  is  no  basic 
difference  from  the  discrete  algorithm  described  in 
(21),  if  the  scaling  factor  T  is  included  in  (22). 

This  is  only  to  make  the  error  equation  analogous 
in  form  to  that  described  hy  equation  (18)]. 

VI  OUTLINE  OF  PROOF  OF  ASYMPTOTIC  STABILITY  FOR  THE 
CLASS  OF  CONTROLLERS  IN  SECTION  IV 

In  this  section  we  present  the  key  ideas  in  the 
proof  of  asymptotic  stability  of  the  model  described 
in  IV.  The  nature  of  the  problem  is  identical  to 
that  resolved  in  [3],  the  only  difference  being  in 
the  description  of  the  augmented  error.  Hence,  the 
augmented  error  is  described  by  a  first  order 
differential  equation  (when  L*(s)  *lL(s)),  or  by  an 
alRebralc  equation  (when  L*(s)  •  XL(s)).  The 
arguments  used  here,  however,  are  analogous  -  if  not 
identical  -  to  those  in  [3].  The  Interested  reader  is 
referred  to  [3]  or  [21]  for  a  rigorous  and  complete 
proof.  We  merely  highlight  here  the  important  points 
in  its  evolution.  We  list  in  the  appendix  key 
definitions  and  lesuas  in  the  construction  of  the 
stability  arguments.  We  again  refer  to  [3]  for  a 
complete  discussion  and  proofs. 

A.  Statement  of  the  Stability  Problem 

Using  the  modified  error  model  in  Section  II, 
it  is  easy  to  show  that  ex,  i  in  equations  (17)  and 
(18),  or  alternatively,  ex»  and  T  in  (19)  and  (20) 
are  bounded.  Moreover,  it  also  follows  that  e(t), 
ex(tK(t),  if(t)£L?  The  stability  problem  is  then 
to  show  that  the  plant  feedback  loop  with  $(t) 
adjusted  according  to  equation  (20)  and  <$(t)eL* 
is  stable  in  the  large. 

B.  Proof  of  Stability 


We  only  need  to  show  that  yp(t)  is  uniformly 
bounded.  Uniform  boundedness  of  all  the  signals  in 
the  loop  follows  by  Lemma  4. 

Considering  the  reduced  error  model,  we  can  write 

yp(t)  ■  «ln(s)r(t)  +  L'1(s)4T(t)oJ(t)  (23) 

where  Wm(s)r(t)  is  a  uniformly  bounded  signal.  The 
second  term  in  the  RHS  of  equation  (23)  can  be 
expressed  as 

L-1(s)$T(t)u(t)  -  [L-1(s)L*(s)][L*-1(s)(>T(t)L*(s)]C(t) 

By  lemmas  4  and  5 

L_1(s)<j>T(t)ie(t)  -  [L*l(s)L*(s))  <J>T(t)C(t)  +  o[sup)y  (t)|  ] 

t>7 

Further,  since  by  (18) 

$T(t)C(t)  -  v(t)  +•  aei(t)CT(t.>rC(t) 

where  v(t)  *  4>T(t)C(t)  -  aei(t)CT(t)r;(t)  is  the 
input  to  the  error  equation 

$T(t)C(t)  -  d(t)  +  a^OCft) 


(i)  ^ 


[L_1(s)L*(s)]v(t)  -  ei(t) 


tL~l(s)L*(s)](ai>T(t)c(t))  «  o [supjyp(t )|  ]  by  hennas 

t  >  _ 

.  2 

3  and  4  and  by  $CL  . 

o%  yp(t)  -  ^(s)r(t)  +  ex(t)  +  o[sup|yp(-;)f] 

ciT 

is  bounded,  since  ex(t)  is  bounded  from  (18),  for 
any  choice  of  L*(s).  &  The  plant  feedback  loop 

is  stable  in  the  large. 

(ii)  kp  unknown 

In  this  case, 

yp(t)  -  [^Wm(s)]  [£*  r(t)+£T(t)u(t)]  - 

yp(t)  -  Wn(s)r(t)  +  fjja  L_1(s)L*(s)  ]  [L*'1^)  *V(s)  ]S(t) 

Analogously  as  in  (1) 

£jEL  L-1(sHT(t)i(t)  -  [Ji£  L-1(s)L*(s)]  ^T(t)’(t)  + 

+  o{sup|  yp(r)l  if 
t>T 

From  Figure  6 

$T(t)£(t)-v(t)+  «CT(t)^(t)  -  Y(t)f(t) 

But  f(t)  -  IL*-l(s)£T(t)  -fT(t)i*-l(s)]‘(t)  -= 

L*-1(s)fr(t)L*(s)|(t)  -  ?T(t)f(t)  -  Isuplv  (t)l  ] 

t  1 1 

And  since  V(t)  Is  uniformly  hounded,  again  wo  conclude 
that  Jlp(t)  is  also  bounded. 
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(111)  discrete-time  model 

For  the  discrete-time  case,  with  v(t)  replaced 
by  v(k)  it  follows  Immediately  [3]  that  v(k)  ♦  0, 

4<K k)  -  0  and  hence  stability  follows  trivially . 

Since  we  established  that  u(t)  is  bounded,  then 
C(c),  the  input  to  the  error  model  is  bounded,  and 
from  the  analysis  in  Section  II, 

lim  V(t)  -  lim  e(t)  »  lim  $(t)  -  0 

£  -*■  00  t  "►  00  t  ♦ 

oo  the  augmented  input  signal  into  the  error  model 
[L*-1(s)(«T(t)-(t>T(t)L’‘-l(s)]u(t)  and  aei(t)CT(t)rC(t) 
also  tend  to  zero  as  t  ♦  » 
oo  e^(t)  -  yp(t)  -  y^ft)  *  0  as  t  •*  • 

VII  GENERAL  COMMENTS 

(1)  The  model  presented  in  Section  IV  represents 
a  very  simple  controller  structure  requiring  a  minimal 
number  of  integrations.  This  translates  into  faster 
response  and  error  dynamics  and  hence  the  potential 
for  applications  to  real  world  problems.  The  part¬ 
icular  structure  described  shows  clearly  the  role  of 
the  relative  degree  of  the  plant  in  determining  the 
underlying  speed  of  adaptation.  This  is  suggestive 
and  is  to  be  compared  with  the  sensitivity  models 
as  in  [24]  used  for  optimization. 

(ii)  The  transfer  function  L-1(s)  is  arbitrary 
and  hence  the  designer  can  choose  it  to  improve 

any  one  of  relevant  quantities  such  as  error  response 
of  the  adaptive  system,  avoiding  to  excite  unmodeled 
system  dynamics, filtering  out  disturbances,  etc.. 

These  questions  have  to  be  investigated  thoroughly 
and  systematically  in  light  of  this  new  model.  The  de¬ 
signer  still  has  no  control  over  the  convergence 
rates  of  the  adaptive  control  algorithms  but  this 
new  representation  of  the  adaptive  system  seems 
promising.  Current  research  efforts  [25]  are  directed 
systematically  toward  understanding  closed  loop  adapt¬ 
ive  processes  and  defining  analytically  the  domains 
in  which  they  evolve,  in  terms  of  relevant  design 
quantities,  so  that  optimization  could  then  take 
place. 

(iii)  The  fact_that  the  error  dynamics  are  in 
effect  governed  by  £“*(8), which  can  be  chosen 
arbitrarily,  could  have  further  implications  on  the 
robustness  properties  of  the  adaptive  system. 

(iv)  He  observe  that  positive  reality  of  the 
error  equations  is  ultimately  only  connected  with 
the  adjustment  of  the  parameters  and  can  be  viewed 
separately  from  the  rest  of  the  plant-model  adaptive 
configuration. 

(v)  Proof  of  the  original  conjecture  formulated 
in  [10]  suddenly  seems  important  and  more  tractable 

In  light  of  the  new  representation  and  as  encompassing 
a  larger  class  of  adaptive  problems,  without  the^ 
limitation  that  has  to  be  adjusted  so  that  irL  . 

VIII  CONCLUSION 

Stability  questions  that  arise  in  the  deter¬ 
ministic  adaptive  control  of  S1S0  systems  and  methods 


for  their  analysis  have  been  reviewed,  with  special 
emphasis  given  to  the  "augmented  error”  systems. 
"Augmented  error"  systems  arise  when  the  relative 
degree  of  the  plant  transfer  function  is  greater  than 
or  equal  to  two.  The  question  of  asymptotic  stability 
of  this  type  of  an  error  system,  even  in  the  deter¬ 
ministic  case,  remained  unresolved  for  a  long-time. 
Recently,  various  proofs  were  proposed  for  specific 
adaptive  controller  designs.  In  Section  IV  of  che 
paper,  a  general  model  for  a  controller  structure  is 
proposed,  using  a  specific  parameterization.  Other 
existing  algorithms  are  seen  to  be  special  cases  of 
this  general  model,  regardless  of  which  approach 
was  used  as  a  basis  for  the  design.  An  outline  of 
a  proof  for  the  model  in  Section  IV  was  given, 
which  is  che  most  general  proof  for  asymptotic 
stability,  that  holds  for  all  the  existing  determin¬ 
istic  adaptive  controllers.  However,  no  specific 
close  form  theoretical  results  are  available  for 
the  convergence  rates  of  these  algorithms  or  their 
behavior  (in  a  global  sense)  in  the  presence  of 
disturbances.  Such  questions  are  the  subject  of 
current  research. 
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APPENDIX 


Definition  1: 


L“  -  {f  :R+*  Rl  sup  I  f(T  )l<  «,  •V‘t£R+] 


Definition  2:  Let  x(t),  y(t)  t  Le.  Let  B(t)  be  a 
continuous  function  such  chat  B(t)  +  0  as  t  ♦  «. 

If  y(c)  ■  S(t)x(t),  we  denote 

y(t)  -  o[x(t)] 

Remark  li 

(i)  If  y(t)  «  o[y(t)],  the  y(t)-*0  u  t»  ■ 

(ii)  If  |y(t)|  ■  o[suply(T)|  ],  then  y(t)-"0  as 

t  «*■  ® 

(iii)  If  ly(t)l  »x(t)  +  o[suply(T>| J  and  x(t)  is 

t  _>T 

uniformly  bounded,  then  y(t)  is  also 
uniformly  bounded. 

Definition  3:  Let  x(t) ,  y(t)£Lg.  If  there  exists 
a  constant  M  >  0  such  that  )y(t)l  £  Mix(t)l  , 
then  ve  denote  ~ 

y(t)  -  0[x(t) ] 

Remark  2:  If  the  input  to  a  linear  exponentially 

stable  system  is  x(t)CLe  and  the  correspond 
ing  output  is  y(t),  then 

y(t)  •>  0[sup|  x(T)l  ] 
t  >T 

Definition  4:  Let  x(t),  y(t)eL”.  If  y(t)  ■  0[x(t)] 
and  x(t)  ■  0[y(t)],  then  ve  say  that  x(t)  and  v(t1 
are  equivalent  and  denote  this  by 

x(t)  '  y(t) 

Definition  5:  Let  x(t),  y(t)eL“.  If  sup  ly(T)  | 

sup|x(T)|  ,  we  say  that  x(t)and  y(t)  grow  at  the 
same  rate. 

Remark  4: 

(i)  If  x(t),  y(t)cLe,  one  and  only  one  of  the 
following  three  conditions  can  hold: 

suplx(T)| suply(T)!  ,  suply(T)1  *  o[sup'x(T><  ] , 
t>  T  t^T  t>T  t>T 

or  suplx(T)'  ■  o(sup'y(t)l  ] 
t>T  t  >T 

(ii)  Jsuplx(i)|  *  o[supiy(T),]  or  supixO)>  - 
t  >  t  t>_l  t  >  ' 

suply(T)i^  jsup  ix(t )l  •  0(supl  y (r  li 
t>.T  t  >  t  t  >  * 

(ill)  Let  an  n-d imensional  vector  x(t):l.'e  he 
unbounded,  then  there  exists  at  least  a 
component  xi(j(t)  sucli  the 

sup  I  xt0C> )!  "  sup  II  x(  07  . 

t  >  T  t  >  T  ‘  ‘ 


